Papers with Selective Disentanglement Unlearning
Disentangling Biased Knowledge from Reasoning in Large Language Models via Machine Unlearning (2025.acl-long)
Copied to clipboard
Zheyuan Liu, Suraj Maharjan, Fanyou Wu, Rahil Parikh, Belhassen Bayar, Srinivasan H. Sengamedu, Meng Jiang
| Challenge: | Existing approaches to disentangle biased knowledge from reasoning are sub-optimal . entangled data makes curation difficult, leading to inclusion of sensitive, toxic data. |
| Approach: | They propose a framework that selectively removes biased knowledge while preserving reasoning abilities. |
| Outcome: | The proposed framework improves fairness accuracy by 14.7% and reasoning performance by 62.6% across multiple LLMs. |